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© Method for comparing and swapping data in a multl-programma data processing system. 

® The method for comparing and swapping data which are located in discontiguous locations in a data 
processing system, comprises the steps of comparing first and second operands which are located in memory, 
and if said first and second operands are equal, loading the value at a fourth operand into a third operand 
located In memory, then setting an indicator in memory that the first and second operands are equal, and 
perfonning a serialization process on the second operand location prior to the time the second operand is 
fetched, whereby a value is fetched from one location in memory dependent on the fact that the value at anoth r 
location does not change. 
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of seiiallzatiol' Oy sofwsre wni ^su,. the 

°st«»ir9P-o»Mvel,«»^ve^ of m»nt»nlna J-s ^.^ ana »e W 

accessing the list at a n'"^- employed. i^oHcations of excessive paging. The 

second method has the restnction tna _^ ^ ^^^^ 

370XA Prin. ops on page A45. g.ves ^^^^^^^ 

and deleters. art systems and methods ;"<='"J ' ^oi. 24. Nov. 1981. pages 

Other specific e^^ples of pno ^ Y ^ ^^^^^^ ^^.^^^ Bulletin. V 

4.320.455. and the arucle ^2?^^^ ^f a lock bit or lock word. ^ulti-processing or 

2V16 to 2723, all of which '"^'^^ ^^^^^ ,ocking mechanisms «" ^"Tj's'^^^ technique includes the 
one technique for -;«';^'"|^;i,"ns described in US «86^^g ^ s in^cSon. each user 0, 

multiprogrammed computing ^3,,^^ -Compare and Swap. U«n9 

lent on of a new insti^^o^ ^^.^s ^ ^^"^'^'^ "^'Sa thrproS:ed data is to be returned 
shared data is pemirtted ^ f^^^ instructions. After processing. ^^^^^ location m 

processing by the ^^^^''l^^',^^^^ Prior to returning the P'°^J^j3^.,rns Using "Compare and 
to the address location of the *a^cl oa« ^ " compared with the data 

t Shared data ^'--■l^X;^:^^^ ^ Z^^^^ comparison, it can be 

Swap." the data content of . ^ the processing. As a resun 3,so 

a^S^ed from the JJ^^; p'^Sssing on the ^J-^l^tlunrrshared data back to the 

detemilned that during "-^^ y^''°°°Jf^, and retijmed a different '^'^^ ^^J^j^^on. it is determined 
accessed the shared daU f<J P^'^^^'^^^ ^o the "Compare and fv^P ^^i^^^Sed value is retained 
addressed storage location. »f. '"^^P° ^een modified by another user, me addressed 
the value of the addressed ^„ ^ modified value. If ^^^""^^'^Z by the user prior 

t,y the user and *e P'OJ-^^^'^rL still identical to the >^ue o^^«^^^Tmodified it Therefore, 
location accessed by t^e '"^'^aj other user had accessed shared (» ^^med. 
to proc ssing. it can b ^ete^nmed n ^^^^ ""i^^^faS^S- (CDS) instmctions are 

CDS instructions. Probably in 
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programs running enabled for interruption (multi-programming) or by programs that are running on a multi- 
processing configuration. In other words, the instructions CS and CDS allow a program to modify the 
contents of a storage location while running enabled, even though the routine may be interrupted by another 
program on the same CPU that will update the location, and even though the possibility exists that another 

s CPU may simultaneously update the same location. , . 

The CS instruction first checks the value of a storage location and then modifies it only if the value is 
what the program expects; normally, this would be a previously fetched value. If the value in storage is not 
what the program expects, then the location is not modified: instead, the current value of the location is 
loaded into a general register in preparation for the program to loop back and try again. During the 

to execution of CS. no other CPU can access the specified location. 

When a common storage area larger than a doubleword is to be updated, it is usually necessary to 
provide special interlocks to ensure that a single program at a time updates a common area. Such an area 
is called a serially reusable resource (SRR). In general, updating a list or even scanning a list, cannot be 
safely accomplished without locking the list. However, the CS instructions can be used in certain restncted 

15 situations to perform the lock/unlock functions and to provide sufficient queuing to resolve contentions, 
either in a UFO or FIFO manner. A lock/unlock function can then be used as the Interlock mechanism for 

updating an SRR of any complexity. ^ ^ ^ ■ 

The lock/unlock functions are based on the use of a "header" associated with the SRR. The header is 
the common starting point for determining the states of the SRR. either free or in use. and also is used for 
queuing requests when contentions occur. Contentions are resolved using "Wait and post . The general 
programming technique requires the program ttiat encounters a "lock" SRR must "leave a mark on the 
wall - indicating the address of an ECB on which it will Wait. The "unlocking program sees the mark and 
Posts «ie ECB. thereby permitting the Waiting program to continue. In most cases, all programs using a 
particular SRR must use either tine UFO queuing scheme or ttie FIFO scheme; Uie two are not mixed. 
When more complex queuing is required, the suggestion In the 370 XA Prin. Ops manual is that ttie queue 
for ttie SRR delocks using one of the two mettiods shown. , . 

As noted tine CS & CDS instructions have been used quite successfully. They enable users to obtain 
access to shared data or headers for the purpose of further processing. The need to prevent access to the 
addressed kjcation when anotiier user is processing data is eliminated by tiie CS instruction. However, the 
30 CS and CDS instiTJCtions apply only to a single word or a double word. 

In contrast, as will be explained, the "Compare and Swap Disjoint" (CSD) and "Compare and Usad 
. (GAL) instructions of ttiis invention enable ttie referencing of two non-adjacent words (or double words in an 

expan(ted^^o^n).^ object of the invention to allow unlocked asynchronous access to lists by^ multiple 
35 processing units or users, while maintaining ttie integrity of Uie lists. 

The object of the invention is achieved by novel procedures which Include ttie creation of novel 
computer instructions, viz.. "Compare and Swap Disjoint" and "Compare and Load." The use of tiiese 
memory-access-serialization instructions allows unBmited asynchronous manipulation of ttiese lists by any 
number of adders and deleters. The mettiod also allows ttie addition and deletion of elements to a hme- 
40 ordered list of eittier RFO or UFO types by multiple processors while maintaining list integrity. The term 
-disjoint- means ttiat ttie two words being acted upon are not adjacent to each ottier In storage. Another 
term for "disjoint" is "discontiguous". 

The novel "Compare and Load" (GAL) insti^ction compares data in a first register witfi an address 
location and fetches into a second register tiie value from a second location based on ttie equality of tiie 
45 comparison. The advantage of ttiis is ttiat one can fetch a value from a location dependent on tiie fact that 
ttie contents of anotiier location have not changed. ^ o » /i-ex 

The novel "Compare and Swap Disjoint" (CSD). as distinguished from tiie "Compare and Swap (OS) 
instruction and tiie "Compare Double and Swap" (COS) instructions, enables ttie program to refer to two 
non-adjacent words or double words; i.e.. it allows for ttie simultaneous updating of two disjoint 
50 (discontiguous) storage locations. This aids in list manipulation because one must deal witti two disjoint 
entities in many practical situations. . ^ ■ 

A preferred embodiment of ttie invention is now described in reference to ttie accompanying drawings 

wh6r3in * 

Rg 1 is a flow diagram showing ttie operation of ttie novel "Compare and Load" instiuction. 
5S Rg 2 is a flow diagram showing ttie operation of tti novel "Compare and Swap Disjoint" instniction. 

Rg. 3 illustrates a double-headed queue RFO list and ttie result obtained after ttie manipulation of 

tiie list by the invention. ^ . ^, ^ ^ , „ 

Rgs. 4A and 4B are flow diagrams illustrating ttie mettiod according to ttie invention of deleting an 
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, The ioregoing description is ^V^bv i^Smpa^' an" Four 
• ^ The addressable data -^'^^^^^'^^^ 6eco6e6 to signify the Co"^P^^^'^°,^'^„3^,,^^^^^^ The five 
The operation code in •^'"^^^^'^.^eTrilrmation in the rema.n.ng °* i. The binary bits 

C.«arent operands are i'^^^;;'*, 7deX a general purpose ^e^ister con^^^^^^^ ^^^^ operand 3. 

binary bits 8-11. designated R1.'de"tn^ 9 ^^i3ter containing ^e^^e information 

address infomr^tion to wh.ch bmary b.ts ..^n is Operand 2. D2(B2). Fetch^Vaiue 

30 shared storage. ^ 1. W. Compare Locatton .s op q^eue 

manipulation processes, the two a « „«,red with the first operand in m 

Iment in the list. ,„,^,erand location in storage D2(B2) ^""^^Xxo the register the third 

- The ^ullwc^d seco^^f ^ ^J^-J^tTtMlB*) 'n storage as the 

as shown .n block 32 in i-ig ^^jj^^^ by «^®/°"'7^^o^ shown in block 4. 

operand R3. the fuUword ^'^^'^J The Condition Code .s se to O^ s^^^^^^ 

When the second operand DZ^b ^ ^^^^nt that serialization. 

CPU to the second <^^l^^Jl ^'^ep is commonly referred to^ ^^^^f ^^""talue in that location is 
.ourth operand is ^-^^^^^^^^ Sn is perfom^ed in step 32 befc.e *e^v^^ ^ ^ 

(D^)^l^?^'^^..Tn.^SS is completed. 
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0 First and second operands are equal, and the third operand has been replaced by the fourth 
operand. ^^^^ second operands are unequal. The first operand has been replaced by the second 
operand. The third and fourth operands are unchanged, 
s 2 - 

3 " 

Program Exceptions 

10 - Access (fetch and store operands 2 and 4) 

- Operation 

- COMPARE AND SWAP DISJOINT (CSD) 
CSO R1,D2(B2).R3.D4(B4) 



}5 



20 



25 



$0 



35 



40 



4S 



SO 



•OP* 


Rl 


R3 


B2 


D2 


B4 


D4 



Referring to Fig. 2. the CSD process begins in block 50 with the general purpose being to compare the 
first and second operands and then llie third and fourth operands under certain conditions. - The first 
operand Rl and the second operand D2{B2) in storage are compared in decision block 52. If they are 
equal, the third operand in R3 and fourth operand D4(B4) in storage are compared in decision block 58. If 
they are also equal, the R1+1 operand (Replace Value 1) is stored at the second operand location 
(Location_1). and the R3 + 1 operand (Replace_Value__2) Is stored at the fourth operand location as 
shown In block 64. The Condition Code is set to 0 as shown In block 66. ^ ^ . ' 

If the first operand Rl and the second operands D2(B2) are unequal, the second operand is loaded into 
the first operand in block 54. If the first and second operands are equal, and the third and fourth operands 
are unequal as decided In block 58. the fourth operand is loaded into the third operand as shown in block 
60. The CC is set to 2 as shown in block 62. w ^ 

Rl and R3 each represent an even-odd pair of general registers and designate an even-number d 
register. R1 +1 and R3 + 1 represent the odd-numbered register of the pair. The second operand D2(B2) 
and fourth operand D4{B4) are words in storage. ^ ^ ^ 

When the result of the comparison of the first and second operands is unequal, the second operand 
remains unchanged, and the fourth operand is not accessed. \When the result of the companson of the third 
and fourth operands is unequal, the second and fourth operands remain unchanged. Access exceptions are 
not recognized against the fourth operand if the first and second operands are unequal. 

When both comparisons done in blocks 52 and 58 are equal, no access by another CPU to the second- 
operand or fourth-operand location is permitted between the moment that the respective operand is fetched 

for comparison and when it is stored. ...... ^ ^ 

Serialization on each operand location Is perfonned before it is fetched in blocks 52 and 58. and again 
after the operation Is completed at block 68. CPU operation is delayed until all previous accesses by this 
CPU to storage have been completed, as observed by channels and other CPUs, and then the second 

operand is fetched at block 52. ..... u ^ . ui eo m« 

If the firet and second operands are equal, then the fourth operand is fetched at block 58. no 
subsequent instructions or their operands are accessed by this CPU until the execution of the CSD 
Instmction Is completed, including placing the result values, if any. in storage, as observed by channels and 
other CPUs. 

The second and fourth operands are designated on a word boundary. The Rl and R3 fields each 
designate an even register. Otherwise, a specification exception is recognized. 



55 Resulting CC: 

0 First and second op rands are equal, and third and fourth op rands are equal. The second and fourth 
operands hav tjeen replaced. 
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- Operation , ^ . novel instnictions may be producuv y ^^^^^^^^ 

NOW. the foHowing illustrates o^o^^^ ^ as having head f J^^' element from a 

o, time-ordered lists or Queu- The queue '^'S- ^'''TTe^* (^^^^^^^^^ 

added to the tail and ^^^f .^^^.^^fq^eue is defined as ^-^q"' S-;oints to the oldest element 

double-headed queue. As ^^^^ ..^^ent in the <^»«"f . ^^JJ" ^-^^^ GWen a representative queue . 

r:;: qre-rsSr f - - - -rrd^rn^o;^-^^ ^. - 0_head pomter must 

. .rpornlftSSt^^^^^^^^^ added to the tail and ta.en 

The queue is defined as having head ^ 

LIST MANIPULATION DEQUEUE and ENQUEUE 
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TABLE 1 

Assume the following declarations; 



I. 
2. 
3, 
A. 
5. 
6. 
7. 
8. 
9. 



QUEUE 


DS 


OF 






QIIEAD 


DC 


A(0) 


Pointer to the head 


of the queue 


QTAIL 
* 


DC 


A(0) 


Pointer to the tail 


of the queue 


ELEMENT 


DSECT 




A Queue Element 




NEXT 


DS 


A 


Pointer to the next 


element on the 


ELEMENTL 


EQU *- 


-ELEMENT 


Length of ELEMENT 





NEWELEM DS CL(ELEMENTL) A new element to add to the Queue 
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DEQUEUEing an element from the QUEUE. (Refer to Fig. 4 for the flow 
diagram. ) 



1. DEQUEUE L 

2. DEQl LTR 

3. BZ 
A. GAL 

5. BC 

6. DEQ2 LTR 

7. BN2 



R2,QHEAD Get the pointer to Head 

R2,R2 Anything there? (Load and Test) 

DEQEXIT No, so exit 

R2,QHEA0,R4,NEXT-ELEMENT(R2)Set RA QITEAD @NEXT 

4, DEQl QIIEAD changed, so try again 

R4,R4 Was the first element the only element? 

DEQ3 No, So Dequeue with CSD 
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R4 R5=R^=0 pointer 

Ti,<> Tail MUST equal the He v 
? lace the q«eue pointers with zero 
R2,R^.Q«^"^ Replace th J, ^^^.^ 

Tf it didn t woTK, 
4,DF.ai ' . so indicate success and exit 

^3 CSD R'-Q^"'-'^ ^^;,D. try again 

16 "^'^^"^^ R4 «NBCr. try again 

BC R2=Ele.ent ELS^ tt2 



8. ^''^ 

10. 
11. 

B 



17 

18. DEQEXIT DS 



35 6. 

7. 



to the QUEUE. 

I. R3 OUEUE Ge'^ ^ „ the QUEUE 

2 ENQl ^« u there anything on the 

3 LTR ^„ do normal enqueue 

, BNZ ^./qbeAD & QTAIL must poiat 

5 to the New Elem-n^ 

It did «or.. so exit 
« ''•^^'"^ pointer to Tail of QUEUE 

9. E«Q2 I* Pointer to New Element 
40 R3,R5 Element has a 

10. , Current Tan f 
11- '"-^ .«ro NEKT pointer 

NEXr-ELEMEKr(R2) Opd^te the point 
^ CSD -^.^^^^•^^•^,7L.t«or.,try«sain 

^3 BNZ ENQl 

14. ENQEXITDS Q« . ^on^ a doubte-headed FIFO Bst 

=r,>.PiiE removes an element °° ^ atomically load 

dedsion Wock 235. »t 
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element 

CAL is used to fetch the value of the next pointer from ttie first element on the chain as addressed by 
the Q head. This operation is performed while ensuring that that element has not been rernoved by 
anotheT process executing the same CAL or dequeue operation. If it is detected that the Q_head has 

5 changed, which indicates that someone else has removed an elem nt from the list, then the program must 
refetch the next query location as described above. If In fact the Q_head did not change, then the program 
does hold a valid next pointer location. . » .u ^ 

The next step in the process is to test the next pointer fetched according to block 234. If the next 
pointer was not zero, then more than one element exists, as detemiined in block 236. and the program then 

,0 sets the replacement value for the Q_head to the next pointer fetched in block 234. In block 237 the 
program sets the Q tail value to the same value as the Q_head value. While making sure the Q_head 
and Q tail do not Change (atomicatly). the Q_head and Q__taii are replaced with zeros. If. on the other 
hand *e Q head or Q tail changed, the program returns to block 232 to test the Q_head again. If the 
Q_head and'Q_tail did"not change, then the program is exited with either zero or the address of the 

IS dequeued element as shown in btock 243. ^ ^ . . »u 

Tuming to block 240 in Fig. 4B. while ensuring that the Q_head and next field do not change, the 
program replaces the value of the Q_head with the value of the second oldest element on ttie queue and 
replaces the value of the next pointer to zero. As indicated in the drawing, this is the use of the Compare 
and Swap Disjoint (CSD) instruction. In decision block 241 a decision is made as to whether the Q_h ad 

20 pointer had changed. If the pointer had changed the program returns to decision block 232 to determine 
whether or not the queue is empty. If the Q_head pointer had not changed, the program proceeds to 
decision block 242. The dequeue routine is exited as shown in block 243. This exit occurs with either zero 
or the address of the dequeued element. ^ »u ^ ^^ow 

Returning to decision block 236. if there had been only one element in the queue and if the Q_head 

25 and Q tail have not changed since loading, then they are both set to zero. The program then proceeds to 
decisioi; block 238 to determine whether the Q_head and Q_tall changed. If the Q_head and Q tai^ had 
changed, the process returns to step 232 to determine if the queue is empty. However, if the Q_head and 
Q tail had not changed, the program is exited with the address of the dequeued element. _ 
~ln using the CSD. the DEQUEUE program replaces the value of the Q_head and the value of the next 

30 pointer location on the first element of the chain, ensuring that they have not changed. CSD then replaces 
ttiem with the address of the second element on the chain and with zero, respectively, ensunng that both 

the Q head and the next pointer have not changed. . ^ , ► 

If lie Q head pointer changed or the next pointer changed, that indicate that either another element 
was added to the chain or during the time between the CAL and the CSD that someone else has removed 

3S an element from this queue. At that point the program reperforms the CAL instruction as ^hown above. If 
neither pointer changed, then the first element on the queue has now been removed and the process is 

SUCC6SSful 

ng 5 illustrates the addition of an element to a double-headed queue. The queue is defined as having 
a Q head and a Q tail, where the Q_head points to the oldest element in the queue and the Q tail 
pointe to the newestdement in the queue. Given a representative queue with elemente a^ded in mis order 
a; B and C. to effect the addition of element N. the Q_tail pointer must be changed to point to element N 
and the pointer from element C (C next pointer) must be changed to also point to element N- 

Rg. 6 is a flow chart of this a novel method of enqueuing. The example in this case is to add an 
element to a double-headed FIFO list as illustrated schematically in Fig. ^ , t »,i-=. 

5. The detailed set of instructions relating to the flow diagram of Rg. 6 are in the second part of Table 

^' As shown in block 100. the Q_head and the Q_tail pointers are fetched atomically. In decision block 
102 the Q head is tested to determine whether the queue is empty. If the queue is not empty, the progranri 
proceeds to block 106 where a new element is added to a non-empty list. The address of the Q_tail and 

60 the address of the new element is established. A register means is used to ensure that the last element 
stays as the last element in the queue. The program next proceeds to decision block 108 where a decision 
is made whether the Q tail or the next pointer have changed. If neither has changed, the program exite the 
enqueue routine. If thro tail or next pointer has changed, the program returns to block 100 and the 
program begins again at that point M neither the Q_tail nor the next pointer changed, that means that a 

55 new element has been successfully added to the queue and the program exits enqueue as shown in block 
112 

If the result from decision block 108 indicates that the Q_tail or the next pointer of the last element has 
changed since being fetohed. the process must start again at block 100. If the answer is no. the queueing 

9 
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shown in the flow diagram. th'S step s ^^^^^^^^ ^, have not clTanged. the program ex. s 

,o still points to element C tt^e osu ^p^^gnd 3 w.tn me condition code is set. 

Se equal, the program replaces the v^ue^ of^rand 3 me „ ^^^^^ 

nSt equal, then register 0P«;^<^;jf„ '^^p^rison with the CS '^^^^^Xares and replaces one 
Note what the CSD instruction does P ^^^^ ^^^Stion CSD and its companion 
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TABLE 2 

Assume the following declarations: 
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1, 


STACK 


DS 


OF 




2. 


TOS 


DC 


A(0) 


Pointer to the top of the stack 


3. 
4. 


ELEMENT 


DSECT 




A Stack Element 


5. 


NEXT 


DS 


A 


Pointer to the next element on the 


6. 


EI.EMENTL EQU 

•A. 


^-ELEMENT 


Length of ELEMENT 


7. 
8. 


NEWELEM 


DS 


CL(ELEMENTL) 


A new element to add to the Stack 
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POPing an Element from the STACK, 
the flow diagram, ) 



(Refer to Figure 8 for 
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1. 


POP 


L 


R2,T0S 


Get the TOS 


2. 


POPl 


LTR 


R2,R2 


Any elements? 


3. 




BZ 


POPEXIT 


No, so exit 


4, 




CAL 


R2 , TOS , R4 , NEXT-ELEMENT( R2) R2&LAR , TOS , R4&LAR • TOS@NEXT 


5. 




BC 


4, POPl 


TOS changed, try again 


6. 


P0P2 


LR 


R3»R4 


The pointer to the next element 


7. 




SLR 


R5,RS 


TOS@NEXT will get zero 


8. 




CSD 


R2,T0S.R4, 


,NEXT-ET.EMENT(R2) Update pointers 


9. 




BC 


4, POPl 


R2 ^OS, try again 


10, 




BC 


2,P0P2 


R4 =Next, try again 


11. 




BNE 


POP 


It didn't work, try again 


12. 


POPEXIT 


DS 


OH 


IF POPed &RAR.R2=Element ELSE R2=0 



Rg. 8 is a flow chart of removing an element from a LIFO list. In the first step the address of the top of 
the stack (TOS) is fetched as shown in block 72, In decision block 74 the top of the stack is tested to 
determine whether it is empty or has a value. If the stack is empty, the POP program is exited at 76 since 
there is nothing to remove. 

However, if the stack is not empty, the Compare and Uad (GAL) instatction in block 78 is used to fetch 
the value of the next pointer from the newest element while making sure that the top of the stack (TOS) 
does not change. If the TOS had changed, as decided in block 82, the program returns to decision block 
74. 

If the TOS did not change, the program proceeds with the Compare and Swap Disjoint (CSD) instaiction 
as shown in block 86. The TOS replacement value is set to the value of the next pointer which had been 
fetched by the CAL instruction in block 78. In block 86 the replacement value for the next field is set to 
zero. While making sure the TOS and the next field do not change, the value of the TOS is replaced with 
the value of the next pointer and the value of the next pointer is then replaced with zero by the CSD 
instruction. 

A decision is made in decision block 79 as to whether the TOS pointer had changed. If the answer is 
yes, the program returns to decision block 74. If th answer is no, a decision is mad in block 84 whether 
the next pointer had changed. If the answer is y s, the program returns to the Compare and Swap Disjoint 
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. -..d as shown in block 88. The program 
. no the POP routine is exited as snow 
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9 The method as in Claim 8 wherein, if the stack contains more than one element, simultaneously 
updating the top-of-stack to point to the second newest element and the next elem nt pointer of the newest 
element to zero, wherein said third operand is the next element pointer of the newest element, said fourth 
operand is the location of the next element pointer of the newest element, and said first and second 
replacement operands are the location of the second newest element. 

10. The method as in Claim 8 or 9 comprising the step of updating the top of the stack to zero if it 
contains only one element. 

1 1 . The method as in Claim 8 or 9 wherein if the stack is empty, returning the value of zero to the user. 
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